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ASSESSMENT  HIGHLIGHTS 

GRADE  9 SOCIAL  STUDIES  ACHIEVEMENT  TESTING  PROGRAM 


This  report  provides  teachers,  school  administrators,  and  the  public  with  a brief  overview  of  the 
results  for  the  June  1991  Grade  9 Social  Studies  Achievement  Test.  It  complements  the  detailed 
school  and  jurisdiction  reports  that  were  mailed  to  schools  and  school  jurisdiction  offices  in  mid- 
September.  The  1991  Provincial  Report,  Achievement  Testing  Program  provides  complete  analy- 
ses of  the  provincial  results  for  the  Grade  9 Social  Studies  Achievement  Test.  This  report  will  be 
available  to  educators  and  to  the  public  in  December  1991. 
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I 1 Achievement  Standard*  Bfi  Actual  Results* 


*the  percentage  of  students  in  the  province  expected 
to  meet  the  acceptable  standard  and  the  standard  of 
excellence 

**the  percentage  of  students  in  the  province  who  met 
the  Achievement  Standard 


Who  Wrote  the  Test? 

Students  enrolled  in  the  regular  Grade  9 Social  Studies 
program  were  expected  to  write  the  1991  Grade  9 Social 
Studies  Achievement  Test.  In  1991, 27  646  students  wrote 
the  test  in  English. 

What  Was  the  Test  Like? 

The  test  had  two  parts: 

Part  A consisted  of  60  multiple-choice  questions  worth  . 
70%  of  the  total  test  mark.  The  test  assessed  students' 
knowledge  as  well  as  their  understanding  and  application 
of  process  skills. 

Part  B consisted  of  one  written-response  question  worth 
30%  of  the  total  test  mark.  Papers  were  scored  on  two 
dimensions:  Support  of  Position,  worth  20%,  and  Expres- 
sion, worth  10%. 

How  Well  Did  Students  Do? 

Fewer  students  than  expected  demonstrated  the  knowledge 
and  skills  required  in  Grade  9 Social  Studies.  Not  enough 
students  met  either  the  acceptable  standard  or  the  standard 
of  excellence.  More  students  met  the  acceptable  standard 
in  process  skills  than  in  knowledge.  (See  the  graphs.) 

Students'  weak  performance  in  recalling  and  applying 
certain  basic  facts  and  concepts  in  all  three  topics  suggests 
that  students  have  not  learned  the  content  of  the  course  in 
sufficient  depth.  Students  need  a deeper,  richer  under- 
standing of  course  content  so  that  they  will  be  able  to  see 
the  relationships  among  the  concepts  and  how  this  knowl- 
edge relates  to  the  world  beyond  the  classroom.  As  well, 
students  must  be  encouraged  through  inquiry  and  discus- 
sion to  use  both  their  knowledge  of  course  content  and 
their  critical  thinking  skills. 


Observations  - Multiple  Choice  (continued) 

Standard  of  Excellence  (continued) 

Students  achieving  at  this  standard  could 

• readily  extract  information  from  a reading  passage  and  use  it  to  support  their  main  idea 

• identify  an  author's  point  of  view  in  a reading  passage  (see  question  7) 

• make  judgments  using  their  knowledge  of  economic  growth 

• show  a clear  understanding  of  the  effects  of  technology;  for  example,  computer  use  in  industry 

• show  a good  understanding  of  the  economic,  social,  and  environmental  implications  of  technology  on 
our  way  of  life. 

Students  achieving  at  this  standard  had  difficulty 

• interpreting  source  documents  that  presented  highly  abstract  ideas  and  synthesizing  the  information 
(see  question  9) 

• recalling  some  basic  facts  and  concepts. 

Observations  - Written  Response 

Assignment 

Although  the  quality  of  writing  in  social  studies  is  better  in  1991 
than  in  1987,  not  enough  students  are  meeting  the  acceptable 
standard.  Teachers  were  disappointed  with  many  of  the  papers 
that  they  marked.  The  markers'  specific  observations  include  the 
following: 

• The  majority  of  students  had  difficulty  focusing  on  the  issue. 
Writing  was  general  rather  than  specific. 

• A number  of  students  confused  the  levels  of  government. 

• Most  students  could  state  a position  but  had  difficulty  commu- 
nicating ideas  in  support  of  their  position. 

• Students  wrote  with  conviction;  their  writing  indicated  a sincere 
concern  for  the  environment.  They  believed  that  government 
should  play  an  important  role  in  solving  recycling  problems  but 
that  government  is  not  fulfilling  this  function  adequately. 

• A small  number  of  clearly  excellent  papers  were  written.  The 
quality  of  thought  and  expression  far  exceeded  the  expectations 
for  Grade  9 Social  Studies  in  these  papers. 

The  Student  Evaluation  Branch  is  preparing  a booklet  comprising 
samples  of  the  full  range  of  student  writing,  the  standards  used  in 
marking,  and  a discussion  of  the  relative  strengths  and  weaknesses 
in  student  writing.  This  will  be  sent  later  this  year  to  schools  that 
have  students  enrolled  in  Grade  9. 


Recycling  is  a growing  concern  in  Alberta. 

HOW  SHOULD  THE  GOVERNMENT  OF 
ALBERTA  BE  INVOLVED  IN  RECYCLING 
PROGRAMS? 

In  presenting  your  opinion,  consider  economic  and 
environmental  factors. 

Your  written  response  may  take  the  form  of  a letter 
to  the  government,  a speech  to  your  class,  a newspaper 
editorial,  or  a position  paper. 

To  support  your  opinion,  use  examples  and  evidence 
from  the  Information  to  Consider  on  page  25,  as  well 
as  from  YOUR  KNOWLEDGE  OF  ECONOMIC 
SYSTEMS. 


Grade  9 Social  Studies 
Percentage  Distribution  of  Scores 
by  Reporting  Category  for  Written  Response 


:the  shaded  portion  indicates  below-standard 
performance 
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This  report  provides  teachers,  school  administrators,  and  the  public  with  a brief  overview  of  the 
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Who  Wrote  the  Test? 

Students  enrolled  in  the  regular  Grade  9 Social  Studies 
program  were  expected  to  write  the  1991  Grade  9 Social 
Studies  Achievement  Test.  In  1991,  27  646  students  wrote 
the  test  in  English. 

What  Was  the  Test  Like? 

The  test  had  two  parts: 

Part  A consisted  of  60  multiple-choice  questions  worth 
70%  of  the  total  test  mark.  The  test  assessed  students' 
knowledge  as  well  as  their  understanding  and  application 
of  process  skills. 

Part  B consisted  of  one  written-response  question  worth 
30%  of  the  total  test  mark.  Papers  were  scored  on  two 
dimensions:  Support  of  Position,  worth  20%,  and  Expres- 
sion, worth  10%. 

How  Well  Did  Students  Do? 

Fewer  students  than  expected  demonstrated  the  knowledge 
and  skills  required  in  Grade  9 Social  Studies.  Not  enough 
students  met  either  the  acceptable  standard  or  the  standard 
of  excellence.  More  students  met  the  acceptable  standard 
in  process  skills  than  in  knowledge.  (See  the  graphs.) 

Students'  weak  performance  in  recalling  and  applying 
certain  basic  facts  and  concepts  in  all  three  topics  suggests 
that  students  have  not  learned  the  content  of  the  course  in 
sufficient  depth.  Students  need  a deeper,  richer  under- 
standing of  course  content  so  that  they  will  be  able  to  see 
the  relationships  among  the  concepts  and  how  this  knowl- 
edge relates  to  the  world  beyond  the  classroom.  As  well, 
students  must  be  encouraged  through  inquiry  and  discus- 
sion to  use  both  their  knowledge  of  course  content  and 
their  critical  thinking  skills. 


Has  Achievement  Changed  Since  1983? 


A special  study  of  changes  in  achievement  was  conducted  in  1991  as  part  of  the  provincial  assess- 
ment. The  results  showed  that  achievement  levels  in  1991  were  higher  than  in  1983  but  have  not 
changed  since  1987.  Details  are  reported  in  the  1991  Provincial  Report,  Achievement  Testing 
Program. 


Test  Blueprint 

The  test  blueprint  shows  the  distribution  of  questions  according  to  the  curricular  content  area  (topic) 
being  assessed  and  according  to  the  knowledge  and  process  skill  objectives  called  forth  by  the 
question. 


Grade  9 Social  Studies 
1991  Achievement  Test  Blueprint 
Part  A:  Multiple  Choice 


TOPIC  CONCEPT 

REPORTING 

CATEGORIES 

OBJECTIVE 
REPORTING 
CATEGORIES  : . 

TOPIC  A 

ECONOMIC  GROWTH:  U.S.A. 

TOPIC  B 

ECONOMIC  GROWTH:  U.S.S.R. 
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52 
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20 
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8% 

10% 

5% 

2% 
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6% 
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3% 
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23.3% 
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Test  Results 

The  following  table  shows  question-by-question  results  and  the  keyed  answers.  There  is  a parallel 
table  in  the  school  and  jurisdiction  reports  that  teachers  can  use  to  determine  the  areas  of  strength 
and  weakness  of  their  students  relative  to  the  province  as  a whole. 


Grade  9 Social  Studies 

Results  for  Individual  Multiple-Choice  Questions 
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15 
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* Difficulty  - percentage  of  students  answering  the  question  correctly 


Has  Achievement  Changed  Since  1983? 

A special  study  of  changes  in  achievement  was  conducted  in  1991  as  part  of  the  provincial  assess- 
ment. The  results  showed  that  achievement  levels  in  1991  were  higher  than  in  1983  but  have  not 
changed  since  1987.  Details  are  reported  in  the  1991  Provincial  Report,  Achievement  Testing 
Program. 

Test  Blueprint 

The  test  blueprint  shows  the  distribution  of  questions  according  to  the  curricular  content  area  (topic) 
being  assessed  and  according  to  the  knowledge  and  process  skill  objectives  called  forth  by  the 
question. 
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Test  Results 

The  following  table  shows  question-by-question  results  and  the  keyed  answers.  There  is  a parallel 
table  in  the  school  and  jurisdiction  reports  that  teachers  can  use  to  determine  the  areas  of  strength 
and  weakness  of  their  students  relative  to  the  province  as  a whole. 
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Observations  - Multiple  Choice 


Students  found  the  multiple-choice  section  of  the  test  very  challenging.  The  following  is  a discus- 
sion of  specific  areas  of  strength  and  of  difficulty  for  Grade  9 students.  Sample  questions  have  been 
provided  to  highlight  the  strengths  and  weaknesses  of  students  achieving  at  the  acceptable  standard 
and  at  the  standard  of  excellence.  For  each  sample  question,  the  correct  answer  is  marked  with  an 
asterisk.  The  percentage  of  students  choosing  each  alternative  is  also  provided. 

Acceptable  Standard  - Sample  Questions  and  Commentary 


38. 

The  most  general  definition  of  quality  of  life  is 

31. 

President  Gorbachev's  attempted  reforms  MOST  CLOSELY 

5.9 

A.  your  job  satisfaction 

6.5 

A.  Lenin's  War  Communism 

77.6 

*B.  how  happy  you  are 

9.4 

B.  Stalin's  collectivization 

4.9 

C.  your  level  of  education 

26.8 

C.  Stalin's  five-year  plans 

1 1.6 

I),  how  much  money  you  have 

57.1 

*D.  Lenin's  New  Economic  Policy 

Question  38  required  students  to  have  a basic  understanding  of  quality  of  Question  31  required  students  to  apply  their  knowledge  of  historical  events  to 

life.  Students  achieving  at  the  acceptable  standard  have  a good  understanding  current  reforms  in  the  Soviet  Union.  Results  indicate  that  students  achieving  at  the 

of  this  concept.  Few  students  confused  quality  of  life  with  materialism.  acceptable  standard  were  unable  to  apply  their  knowledge  of  economic  planning  in 

this  question;  however,  students  achieving  at  the  standard  of  excellence  were  clearly 
able  to  do  so. 

The  strengths  of  students  who  demonstrated  an  acceptable  standard  of  performance  include: 

• a basic,  though  limited,  understanding  of  what  a centrally  planned  economy  - as  in  the  Soviet 
Union  before  1990  - is,  of  the  meaning  of  quality  of  life,  of  primary  industry  in  an  economy,  and 
of  aspects  of  one’s  lifestyle  (see  question  38) 

• an  ability  to  make  simple  inferences. 

Many  students  achieving  at  this  standard  had  difficulty 

• recalling  and  applying  some  basic  knowledge  as  outlined  in  the  course  of  study  (see  question  3 1 ) 

• analysing,  synthesizing,  and  evaluating  sources  of  a more  abstract  nature. 

Standard  of  Excellence  - Sample  Questions  and  Commentary 

Use  the  information  below  to  answer  questions  7 and  9. 


Source  II 

American-born  workers  resented  the  immigrants,  who  were  willing  to  work  for 
less  money.  They  grew  angry  because  they  felt  their  demands  for  higher  wages 
and  better  working  conditions  were  threatened  by  immigrants  who  were  eager  to 
work  under  any  conditions.  The  competition  between  American-born  workers 
and  immigrants  became  intense  as  immigration  increased  and  the  worker 
population  expanded  one-third  faster  than  the  total  population. 


Source  I 

Nearly  every  immigrant  wanted  to  work  and  this  caused  tension  between 
American-born  workers  and  newcomers.  Part  of  this  conflict  resulted  from  a 
lack  of  understanding  of  the  causes  of  unemployment.  Many  American-born 
workers  did  not  understand  that  they  were  being  displaced  because  the 
tremendous  changes  in  manufacturing  had  caused  the  mechanization  of  their 
jobs. 


7.  The  MAIN  point  in  source  I is  that 

16.9  A.  immigration  led  to  the  mechanization  of  American  industries 
4.0  B.  workers  tended  to  be  more  close-minded  and  racist  than  other  people 
65.4  *C.  workers  lost  their  jobs  to  machines  but  blamed  immigration 
13.6  D.  owners  hired  more  immigrants  because  they  were  willing  to  work  for 
less 

Question  7 required  students  to  identify  the  main  point  in  source  I.  A fair 
percentage  of  students  achieving  at  the  acceptable  standard  were  able  to  identify 
the  main  idea,  whereas  a high  percentage  of  students  achieving  at  the  standard  of 
excellence  were  able  to  do  so. 


9.  Based  on  both  sources,  what  generalization  can  be  made  about  immigra- 
tion and  economic  growth? 

35. 1 A.  People  move  to  areas  where  the  economy  is  expanding. 

53.4  *B.  Workers  often  believe  that  immigration  creates  unemployment. 

5.0  C.  More  skilled  workers  than  unskilled  workers  tend  to  immigrate. 

6.3  D.  Immigration  has  lowered  profits  and  slowed  the  growth  of  factories. 

Question  9 required  students  to  use  a higher  level  cognitive  process.  They 
had  to  select  the  generalization  that  could  be  made  based  on  the  two  sources. 
Many  students  achieving  at  the  acceptable  standard  and  some  students 
achieving  at  the  standard  of  excellence  had  problems  selecting  the  correct 
generalization.  Too  many  students  in  both  groups  were  drawn  to  the  first 
alternative. 


ASSESSMENT  HIGHLIGHTS 

GRADE  9 SOCIAL  STUDIES  ACHIEVEMENT  TESTING  PROGRAM 


This  report  provides  teachers,  school  administrators,  and  the  public  with  a brief  overview  of  the 
results  for  the  June  1991  Grade  9 Social  Studies  Achievement  Test.  It  complements  the  detailed 
school  and  jurisdiction  reports  that  were  mailed  to  schools  and  school  jurisdiction  offices  in  mid- 
September.  The  1991  Provincial  Report,  Achievement  Testing  Program  provides  complete  analy- 
ses of  the  provincial  results  for  the  Grade  9 Social  Studies  Achievement  Test.  This  report  will  be. 
available  to  educators  and  to  the  public  in  December  1991 . 


Percentage  of  Students  Achieving: 
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□ Achievement  Standard*  liif  Actual  Results** 


Acceptable  Standard 


Knowledge  Process  Both 
Skills 

Standard  of  Excellence 


Knowledge  Process  Both 
Skills 


*the  percentage  of  students  in  the  province  expected 
to  meet  the  acceptable  standard  and  the  standard  of 
excellence 

**the  percentage  of  students  in  the  province  who  met 
the  Achievement  Standard 


Who  Wrote  the  Test? 

Students  enrolled  in  the  regular  Grade  9 Social  Studies 
program  were  expected  to  write  the  1991  Grade  9 Social 
Studies  Achievement  Test.  In  1991,  27  646  students  wrote 
the  test  in  English. 

What  Was  the  Test  Like? 

The  test  had  two  parts: 

Part  A consisted  of  60  multiple-choice  questions  worth 
70%  of  the  total  test  mark.  The  test  assessed  students' 
knowledge  as  well  as  their  understanding  and  application 
of  process  skills. 

Part  B consisted  of  one  written-response  question  worth 
30%  of  the  total  test  mark.  Papers  were  scored  on  two 
dimensions:  Support  of  Position,  worth  20%,  and  Expres- 
sion, worth  10%. 

How  Well  Did  Students  Do? 

Fewer  students  than  expected  demonstrated  the  knowledge 
and  skills  required  in  Grade  9 Social  Studies.  Not  enough 
students  met  either  the  acceptable  standard  or  the  standard 
of  excellence.  More  students  met  the  acceptable  standard 
in  process  skills  than  in  knowledge.  (See  the  graphs.) 

Students'  weak  performance  in  recalling  and  applying 
certain  basic  facts  and  concepts  in  all  three  topics  suggests 
that  students  have  not  learned  the  content  of  the  course  in 
sufficient  depth.  Students  need  a deeper,  richer  under- 
standing of  course  content  so  that  they  will  be  able  to  see 
the  relationships  among  the  concepts  and  how  this  knowl- 
edge relates  to  the  world  beyond  the  classroom.  As  well, 
students  must  be  encouraged  through  inquiry  and  discus- 
sion to  use  both  their  knowledge  of  course  content  and 
their  critical  thinking  skills. 


Observations  - Multiple  Choice  (continued) 

Standard  of  Excellence  (continued) 


Students  achieving  at  this  standard  could 

• readily  extract  information  from  a reading  passage  and  use  it  to  support  their  main  idea 

• identify  an  author's  point  of  view  in  a reading  passage  (see  question  7) 

• make  judgments  using  their  knowledge  of  economic  growth 

• show  a clear  understanding  of  the  effects  of  technology;  for  example,  computer  use  in  industry 

• show  a good  understanding  of  the  economic,  social,  and  environmental  implications  of  technology  on 
our  way  of  life. 


Students  achieving  at  this  standard  had  difficulty 

• interpreting  source  documents  that  presented  highly  abstract  ideas  and  synthesizing  the  information 
(see  question  9) 

• recalling  some  basic  facts  and  concepts. 


Observations  - Written  Response 

Assignment 


Recycling  is  a growing  concern  in  Alberta. 

HOW  SHOULD  THE  GOVERNMENT  OF 
ALBERTA  BE  INVOLVED  IN  RECYCLING 
PROGRAMS? 

In  presenting  your  opinion,  consider  economic  and 
environmental  factors. 

Your  written  response  may  take  the  form  of  a letter 
to  the  government,  a speech  to  your  class,  a newspaper 
editorial,  or  a position  paper. 

To  support  your  opinion,  use  examples  and  evidence 
from  the  Information  to  Consider  on  page  25,  as  well 
as  from  YOUR  KNOWLEDGE  OF  ECONOMIC 
SYSTEMS. 


Grade  9 Social  Studies 
Percentage  Distribution  of  Scores 
by  Reporting  Category  for  Written  Response 


Although  the  quality  of  writing  in  social  studies  is  better  in  1991 
than  in  1987,  not  enough  students  are  meeting  the  acceptable 
standard.  Teachers  were  disappointed  with  many  of  the  papers 
that  they  marked.  The  markers'  specific  observations  include  the 
following: 

• The  majority  of  students  had  difficulty  focusing  on  the  issue. 
Writing  was  general  rather  than  specific. 

• A number  of  students  confused  the  levels  of  government. 

• Most  students  could  state  a position  but  had  difficulty  commu- 
nicating ideas  in  support  of  their  position. 

• Students  wrote  with  conviction;  their  writing  indicated  a sincere 
concern  for  the  environment.  They  believed  that  government 
should  play  an  important  role  in  solving  recycling  problems  but 
that  government  is  not  fulfilling  this  function  adequately. 

• A small  number  of  clearly  excellent  papers  were  written.  The 
quality  of  thought  and  expression  far  exceeded  the  expectations 
for  Grade  9 Social  Studies  in  these  papers. 

The  Student  Evaluation  Branch  is  preparing  a booklet  comprising 
samples  of  the  full  range  of  student  writing,  the  standards  used  in 
marking,  and  a discussion  of  the  relative  strengths  and  weaknesses 
in  student  writing.  This  will  be  sent  later  this  year  to  schools  that 
have  students  enrolled  in  Grade  9. 


*the  shaded  portion  indicates  below-standard 
performance 


Issues 


During  the  1991  Grade  9 Social  Studies  marking  session,  teachers  were  asked  to  comment  on  the  test. 
Here  is  what  they  said: 

• Motivation  of  Students 

“I  thought  in  99%  of  the  papers  I marked  students  gave  [it]  a good  try.  Students  responded  to  the 
writing  assignment  with  a positive  and  sincere  concern  toward  recycling.” 

“I  was  pleasantly  surprised  at  how  few  of  them  treated  it  in  a flippant  manner.” 

“Most  took  the  topic  seriously  and  tried  to  present  a logical  viewpoint  that  they  could  support.  I was 
encouraged  by  what  I saw.” 

“This  form  of  assessment  is  fine,  but  it  must  have  some  effect  upon  the  students'  actual  mark,  or 
many  simply  do  not  care  to  do  their  best.” 

“Students,  like  anyone,  need  motivation.  Their  responses  depended  on  how  valuable  the  students 
found  the  experience  of  writing  the  test.  Overall  ...  3!!!” 

• Addressing  the  Topic 

“Many  of  our  Grade  9 students  write  creatively.  I was  impressed  with  the  expression  in  most  papers 
but  disappointed  with  the  substance.” 

“Most  students  seem  to  have  a reasonably  good  grasp  of  the  problem  of  waste  management,  and 
some  realistic  solutions  were  evident.” 

“Students  responded  on  an  emotional  level.  They  did  not  bring  into  the  question  their  knowledge  of 
economic  systems.” 

“I  felt  that  generally  students  seemed  to  copy  a lot  of  the  given  data  instead  of  taking  it  and  using  it  to 
provide  fuel  for  their  arguments.” 

“Students  tend  to  formulate  their  opinions  on  hearsay  information  and  lack  good  judgment  about 
political/government  processes.” 

“Most  students  could  deal  adequately  with  the  topic.” 

• Time  Provided 

“Students  can  and  will  do  a much  better  job  if  given  more  time  to  plan,  write,  and  rewrite.  They 
need  the  time  to  go  through  the  steps  they  have  been  taught  in  class.” 

“They  found  that  they  were  a bit  rushed  for  time.” 

“Sufficient  time  was  provided  for  all  my  students  to  complete  the  test.” 

Recycled  Paper:  Recycling  the  Achievement  Test 

When  responding  to  the  assignment,  a few  students  asked  whether  the  achievement  tests  were  printed 
on  recycled  paper. 

Although  we  used  new  paper,  there  is  no  waste  because  all  materials  discarded  by  the  branch  are  sent 
for  recycling.  You  can  expect  to  see  the  recyclable  or  recycled  logo  on  all  our  materials  from  now  on. 

For  further  information  contact  Valerie  Doenz,  Social  Studies  Test  Development  Specialist,  at  427-0010. 


Students 

First! 


Student  Evaluation 


